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[Metadata, Models, Visualization 

and Control] 

Cross Reference to Related Applications 

This application claims priority under 3 5 U.S.C, § 1 19(e) to United States Patent 
Application No. 60/214,494 entitled "Metadata, Models, Visualization and Control" by 
McCullough filed on July 20, 2000, which is assigned to the current assignee hereof 
and is incorporated herein by reference. 

Background of Invention 

[0001] FIELD OF THE INVENTION Th\s invention relates in general to methods and data 
processing system readable media, and more particularly, to methods of modifying 
target documents and data processing system readable media for carrying out those 
methods. 

[0002] DESCRIPTION OF THE RELATED ART Annotation systems have been used by proxy 
sites and third-party annotation services. A portal proxy site may replace an 
expression string with a different expression string. A third-party annotation system 
may insert carets at points within a web page. A plug-in that is provided by Third 
Voice, Inc. or others, can be used with a browser for the annotation system. A first 
visitor can add annotations by right-clicking on the caret and entering his or her 
annotation. Subsequent visitors that have the plug-in can go that website and see the 
first visitor's annotation. 

[0003] 

The World Wide Web Consortium ("W3C") is in the process of specifying a 
Document Object Model ("DOM"). The DOM is a platform and language neutral 
interface that may allow programs and scripts to dynamically access and update the 
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content, structure, and style of documents. The document can be further processed, 
and the results of that processing can be incorporated back into the presented page. 
The page can be represented by "Dynamic HyperText Markup Language" or "DHTML" 
DHTML is a term used by some to describe a combination of HyperText Markup 
Language ("HTML"), style sheets, and scripts that allow a document to be animated. 
The DOM has only recently been devised and attempts to define the requirements of 
the DOM are being addressed by some companies. Currently, specific manners of 
implementing the DOM have not been fully addressed at this time. 

Summary of Invention 

[0004] A method or data processing system readable medium can be used for modifying 
a target document. The method or medium may use metadata and rendering 
instructions to modify a target document to make the target document more user- 
friendly, more informative, or easier to track statistics related to the target document. 

[0005] In one set of embodiments, a method of modifying a target document can 
comprise accessing a target document, a metadata element, and a rendering 
instruction. The target document may comprise a target element. The method can 
further comprise locating the target element to which the metadata element applies. 
The method can further comprise transforming the metadata element into a rendered 
element by using the rendering instruction. In one specific embodiment, the method 
may comprise calculating screen coordinates relative to the target document where 
the rendered element is to be displayed, and the method may further comprise 
inserting the rendered element into the target document at the screen coordinates. An 
opacity may be selected such that at least part of the target element may be seen 
through the rendered element. The method can be iterated for the rest of the target 
elements within the target document if it has more than one target element. 

[0006] In another set of embodiments, a data processing system readable medium can 
have code embodied within it. The code can include instructions executable by a data 
processing system. The instructions may be configured to cause the data processing 
system to perform the methods described herein. 
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[0007] The foregoing general description and the following detailed description are 
exemplary and explanatory only are not restrictive of the invention, as claimed. 

Brief Description of Drawings 

[0008] The present invention is illustrated by way of example and not limitation in the 
accompanying figures, in which: 

[0009] FIG. 1 includes an illustration of a hardware architecture for carrying out a method 
of modifying a target document; 

[0010] FIG. 2 includes an illustration of a data processing system readable medium 
including software code; 

^ [001 1] FIG. 3 includes a process flow diagram illustrating a method of modifying a target 

C5 document; and 

r: [001 2] FIG. 4 includes an illustration of a frame with rendered elements that may be 

'H displayed to a user. 

^ [001 3] Skilled artisans appreciate that elements in the figures are illustrated for simplicity 

O and clarity and have not necessarily been drawn to scale. For example, the dimensions 

fj of some of the elements in the figures may be exaggerated relative to other elements 

^ to help to improve understanding of embodiments of the present invention. 

^ Detailed Description 

. [0014] Reference is now made in detail to the exemplary embodiments of the invention, 
examples of which are illustrated in the accompanying drawings. Wherever possible, 
the same reference numbers will be used throughout the drawings to refer to the 
same or like parts (elements). 

[0015] 

A method or data processing system readable medium can be used for modifying 
a target document. The method or medium may use metadata and rendering 
instructions to modify a target document to make the target document more user- 
friendly, more informative, or easier to track statistics related to the target document. 
In modifying the document, the rendering instructions render the metadata elements 
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that are used in the target document. 

[001 6] A few terms are defined or clarified to aid in understanding the descriptions that 
follow. A network includes an interconnected set of server and client computers over a 
publicly available medium (e.g., the internet) or over an internal (company-owned) 
system. A user at a client computer may gain access to the network using a network 
access provider. An Internet Service Provider ("ISP") is a common type of network 
access provider. A network address includes information that can be used by a server 
computer to locate information, whether internal to that server computer or at a 
different, remote computer or database. Uniform Resource Locators ("URLs") are 
examples of network addresses. A network site corresponds to a location specified by 
a network address. A website is a common type of network site. Note that the 
examples given within this paragraph are for purposes of illustration and not 
limitation. 

[001 7] Before discussing embodiments of present invention, a hardware architecture for 
using embodiments is described. FIG. 1 illustrates an exemplary architecture and 
includes a client computer 1 2 that is bi-directionally coupled to a network 1 4, and a 
server computer 16 that is bi-directionally coupled to the network 14 and database 
1 8. The client computer 1 2 includes a central processing unit ("CPU") 1 20, a read-only 
memory ("ROM") 1 22, a random access memory ("RAM") 1 24, a hard drive ("HD") or 
storage memory 1 26, and input/output device(s) ("I/O") 128. The I/O devices 1 28 can 
include a keyboard, monitor, printer, electronic pointing device (e.g., mouse, 
trackball, etc.), or the like. The server computer 1 6 can include a CPU 1 60, ROM 1 62, 
RAM 1 64, HD 1 66, and I/O 1 68 similar to corresponding items in client computer 1 2. 

[001 8] Each of the client computer 1 2 and the server computer 1 6 is an example of a 

data processing system. ROM 122 and 162, RAM 124 and 164, HD 126 and 166, and 
the database 1 8 include media that can be read by the CPU 1 20 or 1 60. Therefore, 
each of these types of memories includes a data processing system readable medium. 
These memories may be internal or external to the computers 1 2 and 1 6. 

[001 9] The methoc j s described herein may be implemented in suitable software code that 
may reside within ROM 122 or 162, RAM 124 or 164, or HD 126 or 166. FIG. 2 
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illustrates a combination of software code elements 204, 206, and 208 that are 
embodied within a data processing system readable medium 202 on HD 126. In 
addition to those types of memories previously described, the instructions in an 
embodiment of the present invention may be contained on a data storage device with 
a different data processing system readable storage medium. The instructions may be 
stored as software code elements on a DASD array, magnetic tape, floppy diskette, 
electronic read-only memory, optical storage device, CD ROM or other appropriate 
data processing system readable medium or storage device. 

[0020] In an illustrative embodiment of the invention, the computer-executable 

instructions may be lines of compiled C ++ Java, or other language code. Other 
architectures may be used. For example, the functions of the client computer 12 may 

be incorporated into the server computer 1 6, and vice versa. FIG. 3 includes an 

illustration, in the form of a flow diagram, of the structure of such a software 

program. 

[0021] The methods described herein may be implemented by use of code within a plug- 
in that can be used with a browser, both of which may reside on HD 1 26 of the client 
computer 1 2. The plug-in may be obtained from the server computer 1 6, a different 
server computer, or may be created by the user at client computer 1 2. Alternatively, 
code within the server computer 16 may perform the acts described in modifying a 
target document of a different party before transmission to the client computer 1 2. 

[0022] Communications between the client computer 1 2 and the server computer 16 can 
be accomplished using radio frequency, electronic, or optical signals. When a user 
(human) is at the client computer 1 2, the client computer 1 2 may convert the signals 
to a human understandable form when sending a communication to the user and may 
convert input from the user to appropriate signals to be used by the client computer 
1 2 or the server computer 1 6. 

[0023] Before turning to the method of modifying a target document, information used 
for modifying is presented in Appendices I, II, and III, which include examples of a 
target document, metadata, and rendering instructions, respectively. The target 
document may be in HTML or a different markup language, such as Wireless Markup 
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Language. When the code in the target document (Appendix I) is processed by a 
browser without using the methods described herein, a user at client computer 1 2 
may see the following information on his or her screen. "A title" would be centered. 



[0024] 



A title 



[0025] 



This is a paragraph. 



[0026] 



It contains a link to the W3C. 



[0027] "Link" and "W3C" can be hyperlinks to the same or different specific network 

addresses. In this example, if the user clicks on either hyperlink, the client computer 
12 can send the network address "http://www.w3c.org" over the network 14 to the 
server computer 16. The server computer 1 6 may locate and return information 
corresponding to the network address to the client computer 12. 

[0028] Appendix II includes an example of metadata that can be used with the target 

document. The second line defines the target document, which has a network address 
of "http://www.awebsite.com." These particular metadata include two different web 
tags, which are examples of metadata elements. The next three lines after the target 
document line identify the first set of metadata for a web tag. This particular web tag 
has an identifier "42." The location within the target document is specified as the first 
heading within the body. Two parameters are specified and include author and date. 
"Sean" is assigned to the author parameter, and "07/20/2000" is assigned to the date 
parameter. The middle line is a comment line to aid a code developer in locating 
where the web tag is to be placed. The last line for the first web tag is a marker that 
denotes the end of the first web tag. 

[0029] Jhe second we b tag has an identifier of "5." The location within the target 

document is the second link within the first paragraph of the body. Similar to the prior 
web tag, there is an author parameter and a date parameter. The values assigned to 
the author and date parameters are the same as the first web tag. In an alternative 
embodiment, the second web tag could include different parameters, different values 
of parameters, or a different number of parameters when compared to the first web 
tag. A middle line of the second web tag includes a comment line for a code 
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developer. The last of the three lines is a marker to denote the end of the second web 
tag. Additional, fewer, or other web tags could be used. The last line within the 
metadata includes an ending tag for the web tags. 

[0030] Appendix III includes rendering instructions that can be used with the target 
document in Appendix I and the metadata elements in Appendix II. The rendering 
instructions are looking for 7/WEBTAG." When the client computer 1 2 processes the 
metadata in Appendix II, an element called "span" may be used in transforming the 
metadata elements to rendered elements. In this specific example, a web tag may be 
replaced with a block that includes a red background. The value for the author 
parameter may be displayed within the block. 

[0031] Attention is now directed to FIG. 3 relating to a method of modifying a target 

document. The method can comprise accessing file(s) as illustrated in block 302. The 
file(s) can include a target document, metadata element(s), and rendering instruction 
(s), such as those seen in Appendices I, II, and III. The target document, metadata 
element(s), and rendering instruction(s) may be part of one file, two files, three files, 
or more than three files. The method can further comprise locating a target element 
to which the metadata element applies as shown in block 322. Referring to the target 
document in Appendix I, the first web tag may correspond to "link" and may be a 
target element to which the metadata element is to apply. 

[0032] The method can further comprise transforming a metadata element into a 

rendered element with a corresponding rendering instruction as shown in block 342. 
More particularly, the rendering instruction can be processed by the client computer 
1 2 to replace the web tag with the span element. 

[0033] Optional acts may be performed to calculate screen coordinates relative to the 
target document where the rendered element is to be displayed (block 362). The 
screen coordinates may be determined by a browser application operating on client 
computer 1 2. The method may further include an optional act of inserting the 
rendered element into the target document at the screen coordinates (block 364). 
Returning to the example, a red block having the word "Sean" within it may be place 
such that it appears to overlie "link." 
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[0034] The process continues to decision diamond 382 where a decision is made whether 
the target document includes any more elements. If yes, the method locates the next 
target element to which a metadata element applies (return to block 322). In this 
particular instance, "W3C" within the target document is located as the next target 
element, and the method can proceed with the acts as previously described and 
shown in blocks 342 362 and 364 of FIG. 3. Similar to the prior example, a red block 
having the word "Sean" within it may be placed such that it appears to overlie the 
"W3C." When there are no more elements ("NO" branch of the decision diamond 382), 
the method of modifying ends. 

[0035] The client computer 1 2 may display a frame 400 including annotation blocks 402 
and 404 as seen in FIG. 4. Note that the blocks 402 and 404 would be red. The "Sean 
07/06/2000" above the blocks 402 and 404 may be used to show who and when the 
annotations were made. Note this information comes from the author and data 
parameters within the metadata. 

[0036] In an embodiment not shown in FIG. 4, the metadata or rendering instructions 

may be modified to specify an opacity to the annotations. After inserting the rendered 
element, the rendered element overlies the target element, and the target element 
may be seen at least partially through the rendered element. For example, the blocks 
402 and 404 may have only a 5096 opacity that may allow the user at client computer 
12 to see, although somewhat faintly, the underlying "link" and "W3C." Alternatively, 
100% opacity may completely obscure the underlying "link" and "W3C." 

[0037] 

The method can be adapted to a number of other different uses. For example, the 
rendered elements may be displayed as a row or a column of icons. These icons me be 
displayed near an edge of a frame at the client computer 1 2. In this embodiment (not 
shown), "link" and "W3C" would not be obstructed. In another implementation, the 
target element may include numerical information, such as a table of numbers. The 
metadata and rendering instructions may allow the transformation of the numerical 
information to be performed such that the rendered elements include a depiction of 
the numerical information. That depiction may include a representation all the 
numerical information in at least two dimensions. For example, a table of numbers 
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may be displayed as a line graph, a bar chart, a pie graph, or the like. Each of these 
represents a two-dimensional depiction of the numerical information. In an alternative 
embodiment, three or more dimensions may be illustrated by the numerical 
information. For example, the numerical information may include a set of points that 
define a sphere, cylinder, cube, or other three-dimensional object. Additional 
dimensions may be represented. 

[0038] HTTP and FTP protocols and file-system access that may be used within the 
method can be used with many different operating systems, such as Microsoft 
Windows ™ , UNIX ™ , Linux, MacOS ™ , or the like. The metadata and the rendering 
instructions may be accessed in a centralized manner that can support multiple, 
simultaneous users sharing the same metadata and rendering instructions. 

[0039] The rendering agent may select rendering instructions independent of the 

selected metadata so that multiple renderings of the same metadata are possible. 
Additionally, the rendering agent may synthesize multiple sets of metadata to be 
displayed simultaneously in a single target document. Therefore, different 
combinations of metadata and rendering instructions are possible for a particular 
target document. 

[0040] The rendering instructions can include program code that is included in the 

rendered elements. This may enable the rendered metadata to react to user actions. 
For example, a rendered element can be a small button, color-coded to indicate age 
of an in-line message. When the user clicks on the colored button at client computer 
1 2, a window may appear with the full text of a message. 

[0041] The metadata can include user-created annotations, links to other documents, 
statistics from Web server logs, or the like. Some examples can include hit counts, 
peak usage tie-ins, and more advanced analytics, such as most frequent links 
followed in the same visit, product- related information (e.g., total sales, largest cross 
sells, profit, returns, click-to-buy ratios, demographics of users associated with the 
content through purchases or requests for more information, or the like), and the like. 



[0042] 



The use of the metadata and rendering instructions with the target document may 



Page 9 of 21 



allow more information, via annotations, different representations, etc., to be given to 
a user or set of users that may be at computers similar to client computer 1 2. By 
tailoring the information, the user may be able to understanding or more easily review 
the information than would otherwise occur. Simply put, the method can make a 
document more user-friendly, more informative, easier to track statistics, or any 
combination of them. 

[0043] In the foregoing specification, the invention has been described with reference to 
specific embodiments. However, one of ordinary skill in the art appreciates that 
various modifications and changes can be made without departing from the scope of 
the present invention as set forth in the claims below. Accordingly, the specification 
and figures are to be regarded in an illustrative rather than a restrictive sense, and all 
such modifications are intended to be included within the scope of present invention. 

[0044] Benefits, other advantages, and solutions to problems have been described above 
with regard to specific embodiments. However, the benefits, advantages, solutions to 
problems, and any element(s) that may cause any benefit, advantage, or solution to 
occur or become more pronounced are not to be construed as a critical, required, or 
essential feature or element of any or all the claims. As used herein, the terms 
"comprises," "comprising," or any other variation thereof, are intended to cover a non- 
exclusive inclusion, such that a process, method, article, or apparatus that comprises 
a list of elements does not include only those elements but may include other 
elements not expressly listed or inherent to such process, method, article, or 
apparatus. 

[0045] APPENDIX I 

[0046] Target Document 

[0047] <html> 

[0048] <headxtitle>A Web Page</titlex/head> 

[0049] <body> 

[0050] <hl>ATitle</h1> 
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[0051] <p> 

[0052] This is a paragraph. 

[0053] It contains a <a href="http//www.w3c.org">link</a> to the <a 
href=http://www.w3c.org>W3C</a> 

[0054] </p> 

[0055] </body> 

[0056] </html> 

[0057] APPENDIX II 

[0058] Metadata 

[0059] <?xml version="l .0" ?> 

[0060] <WEBTACS TARGET="http://www.awebsite.com'*> 

[0061] <WEBTAG ID="42" LOCATION="body:0/hl :0" AUTHOR="Sean" 
DATE="07/06/2000"> 

[0062] This is an annotation that applies to the first heading of the DOM. 
[0063] </WEBTAG> 

[0064] <WEBTAG ID="5" LOCATION="body:0/p:0/a:l " AUTHOR="Sean" 
DATE="07/06/2000"> 

[0065] This is an annotation that applies to the second link in the first paragraph of the 
DOM. 

[0066] </WEBTAG> 
[0067] </WEBTAGS> 
[0068] APPENDIX III 
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[0069] Rendering Instructions 

[0070] <?xml version="l .0" ?> 

[0071 ] <xsl:stylesheet xmlns:xsl="http://www.w3.org/TR/WD- 

[0072] <xsl:template match=7 w > 

[0073] <xsl:apply-tem palates select=7WEBTAG" /> 

[0074] </xsl:temp!ate> 

[0075] <xsl:template match=7/WEBTAC"> 

[0076] <xsl:element name="SPAN"> 

[0077] <xsl:attribute name-"bgcolor">RED</xsl:attribute> 

[0078] <xsi:value-of select="@AUTHOR7> 

[0079] </xsl:element 

[0080] </xsl:template> 

[0081] </xsl:stylesheet> 



